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ABSTRACT 


Partial  matching  is  a comparison  of  two  or  more  descriptions 
that  iaentifies  their  similarities.  Determining  which  of  several 
descriptions  is  most  similar  to  one  description  of  interest  is 
callea  the  best  match  problem.  Partial  and  best  matches  underlie 
several  knowledge  system  functions,  including;  analogical 
reasoning,  inductive  inference,  predicate  discovery,  pattern- 
directed  inference,  semantic  interpretation,  ana  speech  and  image 
understanding.  Because  partial  rratching  is  both  combinatorial 
and  ill-structured,  admiissible  algorithm.s  are  elusive. 
Economical  solutions  require  very  effective  use  of  constraints 
that,  apparently,  can  be  provided  only  by  globally  organized 
knowledge  bases.  Examples  of  such  organizations  are  provided, 
ana  promiising  avenues  of  research  are  proposed. 
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INTRODUCTION:  WHAT  IS  THE  PARTIAL  HATCHING  PROBLEM? 

A {.artial  match  is  a comparison  of  two  or  more  descriptions 
that  identifies  their  similarities.  Because  typical  descriptions 
comprise  symbolic  property-lists  or  propositional  formulae  , a 
partial  match  of  two  descriptions  includes  tliree  components:  an 
abs traction . consisting  of  all  properties  or  propositions  common 
to  both  compared  aescriptions ; and  two  residual  terms, 
representing  the  properties  that  are  true  of  only  one  or  the 
other  of  the  descriptions.  If  the  two  comipared  aescriptions  are 
A ana  3,  the  partial  match  of  A and  B,  cenoted  PM(A,B),  is  (A*B, 
A-A*B,  B-A*B)  , where  A*B  aenotes  the  abstraction  of  A and  3,  ana 
A~A*B  and  B-A*B  denote  the  properties  of  A and  B,  respectively, 
that  are  not  contained  in  A»B.  In  other  papers,  partial  .matching 
has  been  variously  referred  to  as  interference  matching . 
generalization  or  correspondence  mate ing  [9,  10,  14,  15,  37,  40]. 


The  premise  of  this  paper  is  that  the  partial  matching 
problem  is  of  fundamental  importance  for  pattern-directed 
inference  ana  other  knowleage-basea  activities.  WJiile  some 
well-structurea  problems  ttay  be  solvable  ty  conventional 
algorithmic  m.ethoas,  it  appears  that  the  niajority  of  com.plex 
problems  cannot  be  solvec  with  a small  set  of  predefined, 
pattern-matching  rules  that  are  applies  in  an  all-or-none 
fashion,  exactly  as  coded.  Just  as  laws  trust  be  flexibly 
interpretea  to  regulate  complex  social  interactions  in  reasonable 
ways,  so  is  it  true  in  systems  employing  large  am.ounts  of 
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knowledge  to  complex  problems  that  each  element  of  knowlecge 
shoulc  influence  the  outcomes  of  numierous  decisions  without 
dominating  any.  In  such  systems,  many  diverse  sources  of 
influence  must  be  pooled  bo  identify  the  best  or  most  s_trongly: 
inaicated  course  of  action  at  each  moment  in  time.  Partial 
m.atching  and  best  m.abching  are  the  mjechanism.s  for  accom.[. lishing 
this  control. 

In  adcition  to  its  role  in  identifying  the  commonalities  anc 
differences  of  comparable  situations,  partial  miatching  can  be 
interpretec  in  two  other  ways.  The  seconc  role  of  partial 
matching  is  to  ascertain  how  well  an  observed  event  satisfies  the 
prescribed  constraints  of  an  iceal  or  irototviic  situational 
description.  Identifying  the  best  match  between  the  description 
of  an  observed  event  and  alternative  prototypes  enables  the 
current  situation  to  be  recognized  as  an  instance  or  special  case 
of  one  of  the  prototypes.  Those  relationships  shared  by  both 
descriptions  are  the  constraints  of  the  prototype  that  the 
observed  event  sabisifies.  Any  residual  properties  of  the 
prototype  are  unsatisfied  constraints.  Classifying  an  event 
according  to  its  best  match  among  alternative  prototypes  is 
tantamount  to  pattern  recognition  by  constraint  satisfaction  (Cf. 
[ 1])  . 

The  third  role  of  partial  matching  is  similar  to  constraint 
satisfaction.  In  this  case,  too,  a description  of  data  is 
compared  with  descriptions  called  temi lates  . case  frames  . 


schemata  or  frames.  These  frames  are  usually  hierarchically 
organizec  , empirical  or  conceptual  descriptions  of  observable 
phenomena.  In  short,  frames  constitute  a system's  knowledge  of 
its  world.  Vft^en  the  best  matching  frames  are  ascertained,  the 
aata  are  interpreted  by  imp-osing  the  frame  structure  upon  tfiem. 
For  example,  in  a speech  understanding  task  the  data  might 
consist  of  an  array  of  hypthesizec  worcs , and  the  templates  woula 
be  empirical  phrase  structures  of  the  language.  Tl/e  best-matched 
temiplates  determjine  how  the  worcs  should  be  parsed  and 
semantically  interpreted.  a general  rule,  it  appears  that 
semantic  interpretation  is  best  conceivec  as  the  mapping  between 
current  cata  ana  previously  inferred  schemata.  Because  the 
superficial  aspects  of  most  observec  situations  differ 
substantially  from  all  previously  encountered  ones,  semantic 
interpretation  is  funcamentallj  a problem  of  partial  matching. 

In  the  next  section  , several  applications  of  partial  and 
best  matches  are  presented  to  convey  the  generality  and 
cifficulty  of  the  partial  matching  problem.  Subsequently,  a 
criterion  for  the  acm issibility  of  partial  matching  algorithm.s  is 
discussec  which,  though  simple  and  reasonable,  is  difficult  to 
realize.  In  the  last  sections,  the  principal  features  of  the 
partial  matching  problem  are  discussed,  ana  some  promising 
approaches  towara  its  solution  are  proposea. 


SOME  APPLICATIONS  OF  PARTIAL  MATCHING 


In  this  section,  several  at  plications  are  briefly  discussed 
to  illustrate  the  generality,  iuiportance  , and  cifficulty  of  the 
partial  ana  best  match  problems.  The  applications  considered 
include  analogical  reasoning,  semantic  interpretation,  inauctive 
inference,  predicate  aiscovery  , pattern-directed  inference,  and 
speech  and  image  uncerstanding . In  each  case,  the  central  problem 
is  finaing  a best  match  between  two  data  cescriptions  or  between 
a data  description  ana  existing  knowleage . This  nearly  always 
entails  searches  of  exponential  problem  spaces. 

Analogical  Reasoning . While  this  category  properly  em  braces 
numerous  problems  of  widely  varying  specificity,  the  most  well 
stuaied  is  "A  is  to  B as  C is  to  which,  D1 , D2 , ...,  Dn?"  As 

several  researchers  have  shown  [6,  38],  an  effective  program  for 
solving  these  problems  is  as  follows: 

(1)  Compute  the  partial  matches  PM{A,  B)  , PM(C,  D1),  ..., 
PM(C,  Dn). 

(2)  Determine  the  test  match  between  PM(A,  B)  and  one  of 

PM(C,  D1),  ...,  PM(C,  Dn).  If  the  test  match  is 

PM(C,  Dk) , Dk  is  the  test  solution  to  the  problem. 

Recall  that  PM(X,  Y)  comprises  three  terms,  the  abstraction  X*Y 
ana  the  resiauals  of  X ana  Y.  Thus,  the  partial  match  between  A 
ana  B aefines  a viewpoint  for  interpreting  wtiat  changes  were 
necessari  to  transform  A into  B;  i.e.,  the  pair  A-B  induces  a 
transformation  [A  ->  B] . This  transformation  is  implicit  in  the 
structure  PM(A,  B)  = (A*3,  A-A»B,  B-A*B) ; A»B  specifies  which 
properties  of  A were  retained,  A-A*3  specifies  which  properties 
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of  A were  aeleted,  ana  B~A*B  specifies  which  pro(.erties  were 
added  to  A by  the  transformation  cf  A into  B. 

The  partial  matcli  between  PM(A,  B)  and  PM(C,  Di)  (for  some 
i)  can  be  viewec  as  a comparison  of  two  ordered  lists  and  is 
aefined  as  PM(PM(A,  B)  , PM(C,  Di))  = ( ( ( A»B)  * ( C»Di ) , (A-.A«B)»(C- 
C*Di) , ( B-A*B) * ( Di-C*Di ) ) , R1 , R2) , where  R1  and  R2  are  the 
appropriate  resiaual  terrtis.  The  abstraction  of  this  partial 
n.atch  consists  of  three  terrr.s:  (A*B)*(C*Di)  comprises  all 
properties  common  to  all  of  the  aescriptions  , A,  B,  C,  ana  Di 
(the  partial  matching  op^erator  * is  associative);  (A-A*B)*(C- 
C*Di)  con  prises  all  properties  removed  from  A and  C in 
transforming  them  to  3 ana  Di , respectively;  ana,  similarly,  (B- 
A*B) • ( Di-C*Di ) comprises  all  properties  added  to  A and.  C in 
transforming  them  to  B and  Di , respectively.  Thus,  the  original 
analogy  problem  is  reducible,  through  partial  matctiing,  to  a 
question  of  choosing  the  one  combination  of  common  , deleted,  and 
added  properties  that  is  most  persuasive  or  plausible.  Because 
any  answer  to  this  question  must  rest  on  empirical  or  subjective 
criteria,  nothing  of  general  validity  can  be  added  to  this 
analysis . 

Another  use  of  partial  matching  for  analogical  reasoning 
occurs  in  Merlin  [28].  In  this  system,  any  object  can  be 
interpreted  as  a special  case  of  another  whenever  their 
aifferences  do  not  outweigh  their  similarities.  As  an  example, 
suppose  we  wished  to  play  baseball  with  only  a bat  and  a tennis 
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ball.  In  Merlin's  framework,  the  feasibility  of  playing  shoula 
be  directly  related  to  the  reasonability  of  viewing  a tennis  ball 
in  the  role  of  a baseball.  Such  a viewpoint  can  be  achieved  by 
partial-matching  their  descriptions . Suppose  tennis  tall  were 
cefined  as  a "bouncy,  hollow,  light,  fuzzy,  four-inch  spheroic 
that  is  forcefully  hit  in  the  game  of  tennis"  anc  a baseball  were 
defined  as  a "hard,  solid,  leather-covered,  moderately  heavy, 
four-inch  spheroid  that  is  forcefully  hit  in  the  game  of 
baseball."  In  this  case,  the  abstraction  of  the  two  descriptions 
specifies  that  both  objects  are  four-inch  spheroids  hit 
forcefully  in  games.  The  residuals,  however,  specify  that 
whereas  the  baseball  is  hard,  solid,  leather-coverec  , moderately 
heavy  and  used  in  the  game  of  baseball,  the  tennis  ball  is 
bouncy,  hollow,  light,  fuzzy  and  used  in  the  game  of  tennis. 

To  decide  if  the  tennis  ball  will  suffice  as  a makeshift 
baseball,  these  residuals  must  be  reconciled.  One  simplifying 
approach  to  reconciliation  employs  semantic  categories.  If 
correspondences  between  pairs  of  residual  properties  can  be 
established  so  that  each  difference  is  inter  pretable  as  a 
specific  dimensional  variation  , the  significance  of  the  overall 
difference  can  be  decomposed  and,  thus,  easily  apprehended  and 
evaluatec.  A hierarchical  organization  of  the  system's  knowledge 
greatly  facilitates  such  a decomposition.  For  example,  the 
cifference  hollow-solid  can  be  reconciled  by  interpreting  it  as  a 
variation  on  the  dimension  of  "structure"  or  "construction  type." 


As 


result  , a tennis  ball  can  be  viewed  as  a type  of  baseball 


that  is  hollow  (rather  than  solid),  light  (rather  than  moderately 
heavy),  fuzzy  (rather  than  leather-covered),  used  in  the  game  of 


tennis  (rather 

than  baseball) , 

and  bouncy 

( rather 

than 

some 

unspecif ied 

related  property 

of  a baseball ) . 

If 

these 

aifferences  do 

not  outweigh  the 

similarities 

of  the 

two 

, the 

tennis  ball  will  serve  admirably. 

Before  leaving  this  example,  consider  the  role  of  partial 
matching  and  resiauals  in  establishing  the  correspondence  between 
objects.  First,  the  two  objects'  descriptions  were  obtained  from 
a aictionary  or  seitiantic  network.  Second,  the  properties  comim.on 
to  both  were  abstracted  by  intersecting  their  property-lists. 
Third,  the  residuals  were  forced  into  possible  corresponding 
value  pairs  by  finding  dimensions  that  embraced  both  values. 
Note  that,  in  general,  reconciling  the  cifference  between  two 
arbitrary  values  requires  a recursive  application  of  the  partial 
matching  scheme.  Finally,  the  best  match  maximizes  the 
similarities  and  minimizes  the  differences  (according  to 
exogenous  criteria)  between  the  con.pared  descriptions. 

Other  sorts  of  analogical  reasoning  tasks  can  be  formulated 
easily.  For  example:  (1)  If  I know  a detailed  procedure  (ordered 
operations  on  operancs)  to  accomplish  a specific  function 
(establish  particular  relationships  on  the  operands)  , how  co  I 
mocify  the  proceaure  to  accomplish  similar  objectives  on 
qualitatively  aifferent  operands?  Answer:  try  to  find  related 
operations  applicable  to  the  new  operands  that  perform  simiilar 
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functions.  (2)  If  I want  to  fersuade  sorr,eone  that  X causes  Y tut 
Gon't  have  specific  examples,  what  can  I do?  Answer:  find  an 
exaiT;[.le  where  X'  causea  Y'  ana  X is  to  X'  as  Y is  to  Y'.  Despite 
the  fact  that  such  arguments  are  not  strictly  logical,  many 
people  fine  them,  persuasive  when  the  unaerlying  analogies  are 
p lausitle . 

Semantic  Interpretation . The  assignm.ent  of  test-matchea 
fram.es  as  the  semantic  inter pretation  of  vertal  material  was 
previously  m.entionea.  There  is  a secona  way  in  which  partial 
m.atching  supports  sem.antic  inter  pretation . In  this  case,  two  or 
m.ore  concepts  sharing  certain  syntactic  relationships  stim.ulate 
restrictec  sorts  of  ''spreading  activation"  searches  of  a semantic 
network.  When  the  searches  emanating  from  the  original  concepts 
intersect  , the  connecting  path  defines  the  semantic 
interpretation  of  the  syntactic  structure  [24,  31].  For  example, 
a novel  noun-noun  phrase  encountered  in  a text,  such  as  "lawn 
mower,"  can  be  semantically  interpreten  by  fincing  the  test  matcbi 
among  the  relationships  that  radiate  from  the  two  concepts  "lawn" 
ana  "mower"  in  a network  embodying  cictionary  definitions.  In 
this  example,  the  best  such  match  entails  tV.e  following 
paraphrased  inter pretation : a "lawn  mower"  is  a machine  that  cuts 
grass  or  similar  plants  [24].  Spreading  activation,  intersection 
searches  are  now  widely  applied  in  computer  science  ana 
psychology.  Their  similarity  to  the  search  techniques  employed 
by  Merlin  is  apparent.  Regaraless  of  the  particular  knowledge 
representation  aaoptea,  the  essential  function  of  thiese  systems 
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is  to  fina  the  test  niatch  {.ossible  under  the  constraints  iir.poGea 
by  the  current  knowledge. 


Incuctive  Inf erence . Several  researchers  have  shown  that 
(.atterns,  conce(..ts,  ana  production  rules  can  be  inferrec  by 
.lartial-riiatching  exan^ples  to  discover  the  consistently  re{.eated, 
hence  presunjatly  criterial,  {.roperties  [3,  4,  8,  9,  1C,  14,  15, 
18,  19,  3^,  37,  40].  To  illustrate,  consider  the  following 

examples  of  several  classes: 


Example  1:  Tom  and  Jack  are  brothers.  Jack  is  the  father 
of  a boy  named  Bill  who  is  unaer  10.  Both  Tom  and  Jack 
are  in  their  fifties.  Jack's  brother  is  Bill's  Uncle 
Tom . 

Example  2:  Mary  is  the  mother  of  twin  sons.  Bill  and  Jim. 
Mary  is  in  tier  forties,  while  the  boys  are  both  14.  !lary 
has  two  brothers  who  are  the  boys  Uncles  Tom  and  Steve  . 

Example  3:  Sue  has  no  brothers  or  sisters.  Her  mother  is 
Jane,  ana  Jane  has  has  a brother  namied  Fred.  Frea  is 
Sue ' 3 uncle . 

Example  4:  Fred  was  a brilliant  Negro  who  lived  all  of 
his  life  in  a predominantly  white,  racist  country. 
Because  he  was  powerless  and  intimicated  , Fred  was 
humjiliatingly  subservient  to  the  whites  in  his  community. 
Fred  was  an  Uncle  Tom. 

Example  5:  Because  John,  an  aging,  impoverished  Negro, 
was  humiliatingly  subservient  to  Southern  whites  , the 
young  blacks  in  his  town  callec  him  Uncle  Tom. 


These  examples  will  support  a number  of  both  correct  and 
incorrect  inferences  that  are  equally  plausible.  For  example,  if 
Examples  1 anc  2 are  p artial-m atchea  , one  inference  is  that 
parents  are  at  least  40  years  ola  and  chilcren  are  14  or  younger. 
However,  the  type  of  inference  that  1 want  to  draw  attention  to 
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here  has  to  do  with  notions  of  "Uncle."  By  partial-matching  I 

Examples  1 and  2,  it  is  reasonable  to  infer  that  an  uncle  of  x 

is  the  brother  of  the  parent  of  x.  However,  the  best  partial 

match  of  these  two  examples  would  entail  the  stronger  inference 

that  x's  Uncle  Tom  is  the  brother  of  x's  parent,  who  is  at  least 

forty,  while  x is  no  older  than  1 ^4 . 

A valic  inference  of  the  concept  of  "uncle"  requires 
partial-matching  all  of  Examples  1,  2 and  3.  whereas  a valic 

inference  of  the  concept  of  "Uncle  Tom,"  requires  comparing 
Examples  4 ana  5.  This  illustrates  one  of  the  perplexing 
problems  regarding  the  role  of  partial  matching  in  inductive 
inference.  While  it  is  possible  to  infer  valid  rules  by  partial- 
matching  enough  examples  to  elimiinate  all  irrelevant  properties, 
partial  miatching  is  also  necessary  to  determine  which  examples 
illustrate  the  same  concept.  Knowing  that  Examples  4 and  5 
should  be  compared  to  infer  the  meaning  of  "Uncle  Tom,"  rather 
than  comparing  Examples  1,  2,  4,  ana  5,  requires  additional 

knowledge  . 

Suppose  a learning  system  were  asked  to  decide,  based  only 
on  its  knowledge  of  the  five  examples,  if  a certain  55-year-old 
Negro  namea  Sam  could  be  considered  an  uncle.  To  answer,  it 
woula  necessarily  seek  similarities  between  the  properties  of  Sam 
and  previous  examples  of  uncles.  If,  instead  of  actually 
retaining  all  examples,  the  system  had  only  stored  some 


"sufficient"  set  of  rules  induced  by  partial-matching  arbitrarily 


-11- 


selected  subsets  of  examples,  its  current  classif ication  would 
have  a good  chance  of  being  incorrect.  Because  most  systems  do, 
in  fact,  attempt  to  store  only  a minimal  set  of  rules  that  can 
'cover"  the  data  [25,  35],  they  are  prone  to  errors  caused  by 
cecisions  , about  what  combinations  of  properties  are  important, 
made  before  the  properties  of  a test  item  are  known.  A system 
that  stores  its  examples  and  postpones  inferencing  until  the  item 
to  be  classified  is  fully  specified  has  a significantly  reduced 
probability  of  error.  In  the  current  example,  such  a system 
would  be  guaranteed  to  have  sufficient  evidence  to  infer  bothi 
that:  if  Sam  is  the  brother  of  a parent,  he  may  be  labeled  an 
uncle;  and  if  he  is  subservient  to  whites,  he  ii.ay  be  an  Uncle 
Tom . 


The  important  point  to  observe  is  that  the  properties  of  the 
item  to  be  classified,  nob  the  rrcperties  of  the  training  data . 
determine  which  inferences  should  be  made.  Obviously,  then,  many 
inferences  cannot  be  anticipated  or  generated  until  the  problem 
is  fully  specif iec.  In  short,  optimal  performance  in  inductive 
inference  requires  a "wait-and-see"  approach.  In  actual 
applications  of  the  partial  matching  mechanism  to  pattern 
classification,  the  improved  performance  of  wait-and-see 
classifiers  has  repeatedly  teen  observed  [5,  11]. 


The  genera 
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structurea  or  relational  concei.t3  [3,  9,  1C,  14,  15,  37,  33,  4C], 
transformational  graii.ri,ar  rules  [9,  1C,  38],  anc  other  [ conai  tion 
->  action]  (.roauctions  [33]. 

Preaicate  Discovery . Wiile  the  ty{.e  of  incuction  discussec 
in  the  previous  section  assumes  the  jrior  discovery  ana  encocing 
of  those  proferties  neeced  to  express  a rule,  partial  rratching 
provides  a basis  for  aiscovering  new  preaicates  too.  For 
exam.ple  , if  a learner  were  exposes  to  the  following  sentences  , it 
woula  have  a good  basis  for  several  interesting  incuctions: 


Example  1 : Because  John  is  so 
fine  clothes  that  fit  him. 

tall  , 

it 

is 

cifficult  to 

Exam,  pie 
clothes 

2:  Because  Mary  is  so 
that  can  fit  her. 

short  , 

it 

is 

hard  to  get 

Exam  pie 

3:  Because  Joanne  is 

so  fat  , 

it 

is 

irr  possible  to 

get  apparel  that  is  the  right  size. 

Example  4:  Because  Tom  is  so  skinny  , it  is  not  possible 
to  find  clothes  that  are  suitable. 

Using  only  superficial  characteristics  of  the  string 
representations  of  these  examples,  the  following  comtron 
abstraction  woula  be  proauced  by  partial-matching: 

(Because  u is  so  v,  it  is  w to  x) . 

The  corresponding  resicual  values  from  the  four  examples 
asGociatea  with  each  variable  u,  y,  w ana  x are  as  follows: 

y : 

V : 


(John,  Mary,  Joanne,  Tom) 
(tall,  short,  fat,  skinny) 


-13- 


w:  (aifficult,  hara  , irr.[.ossit le  , not  possitle) 

x:  (fine  clothes  that  fit  hiir  , 

get  clothes  that  can  fit  her  , 

get  apparel  that  is  the  right  size  , 

fine  clothes  that  are  suitatle). 

Thus,  with  only  four  exarrples  anc  very  little  knowlecge  , 
reasonable  inferences  regarcing  four  apparent  categories  of 
natural  language  coulc  be  generated.  The  four  distinct  values 
associatec  with  each  of  the  variables  are  apparently  subsets  of 
the  possible  aon.ains  of  associatec  (unknown)  predicates.  For 
exan,  pie  , John,  Mary,  Joanne  anc  Ton.  are  four  of  the  possitle 
values  of  the  attribute  "nane.''  If  this  attribute  hac  already 
been  known  to  the  systen  , partial-natching  of  the  exanples  woulc 
have  preservec  the  connon  "nane"  attribute  , and  a slightly  none 
infornative  abstraction  woulc  have  been  procuced  , such  as: 

(Because  the  thing  naned  u is  so  v,  it  is  w to  x 

Thus,  u,  V,  anc  w contribute  to  the  discovery  of  the  categories 
of  Q.ane  , tgey  shage  attributes  . anc  expressions  for  "cif f icult  to 
achieve  ' . For  the  purposes  of  nachine  learning,  knowlecge  of 
ttiese  interpretations  p_er  se  is  unnecessary.  All  tt.at  apparently 
is  necessary  is  to  infer  the  existence  anc  con  position  of  such 
categories  (unary  predicates),  anc  this  nay  be  done  whenever 
cifferent  constants  are  corresp oncents  in  correctly  partial- 
natchec  cescri ptions . 

Continuing  with  the  previous  exanple,  it  is  also  interesting 
to  conpare  the  resicuals  associated  with  variable  x by  a 
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. recursive  application  of  partial  matching  like  that  enplo^ec  in 

I Merlin.  As  a result  of  recursive  partial  rr-atches  of  the  four 

[ resiaual  x strings,  the  following  sequence  of  inferences  will  te 

I produced: 

(1)  Infer  the  category  FIND  = {fine,  get}. 

(2)  Infer  the  category  CLOTHES  = {clothes,  apparel}. 

(3)  Infer  the  category  FIT  = {fit  liirr,  can  fit  her,  is 
the  right  size,  are  suitable}. 

Then  the  abstraction  of  the  residuals  of  x is: 

(FIND(a)  CLOTHES(b)  that  FIT(.c)). 

Notice  that  this  abstraction  is  itself  a cancidate  for  a new  type 
of  ternary  relation  that,  by  definition,  is  true  of  any  triple 
(a,  b,  c)  constituted  from  the  categories  FIND,  CLOTHES,  ana  FIT, 
respectively.  Any  such  triple  is  an  instance  of  this  general 
template  and  has  the  obvious  inter pretation . Such  a template  is 
a plausible  model  of  the  natural  language  expression  for  finding 
clothes  that  f it . In  any  case,  a capacity  exists  to  identify 
plausible  syntactic  categories  and  semantic  tem.plates  by 
partial-matching  even  a small  number  of  similar  verbal  strings. 
This  approach  to  predicate  aiscovery  has  teen  successfully 
applied  to  a number  of  restricted  languages  [9,  17,  36]. 

Pattern^-oirected  inference . One  of  the  concepts  that  has 
captured  the  imagination  of  m.any  computer  scientists  and 
psychologists  is  that  of  frames,  prototypes,  templates,  scripts 


w 
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or  scherr.ata  [2,  26].  Fran.es  are  su[.i.03ealy  knowleage  units  that 
aelineate  the  elen.ents  of  {.hysical  or  conce{.tual  events  ana 
express  the  constraints  by  which  they  are  relates . Distinct 
fraaes  have  teen  i.roj;osed  for  every  orainary  {.hysical  object, 
typical  configurations  of  objects,  ana  aost  observable  phenoaena 
(e.g.,  aining  at  a restaurant  or  shopp-ing  for  food).  Wiile  there 
is  l.rirLa  facie  evicence  supporting  the  theory  that  people  have 
such  knowledge,  there  is  little  concrete  unaerstanaing  of  how 
this  knowledge  can  te  exp.loited  to  sinplifj  reasoning  processes. 
V./liat  can  te  universally  agreed  upon  is  trivial:  whenever  a 
situation  is  encounterec  where  existing  knowleage  is  applicable, 
that  knowleage  shoula  be  applies  to  constrain  the  possible 
inter pretations  attritutec  to  otservea  phenorrena. 

In  this  fraaework,  the  key  issues  ar«^  how  relevant  knowleage 
can  be  iaentifiec  efficiently  ana  applies  ei festively . Thus,  for 
the  rrorr.ent,  it  will  be  assunec  that  a frane  exists  for  cescriting 
every  interesting  pattern  of  relationships . Suppose,  for 
exanple,  that  the  nuniter  of  franes  relevant  to  iirage  processing 
is  about  1CG,CCC,  inducing  ones  for  farriliar  faces,  builaings, 
autorrobiles  , buses,  boaies  , trees,  mountains,  furniture  , ana 
in,  p lerr  ents  of  various  sorts.  !Jow , suppose  that  sorreone  presents 
a photograph  selectee  ranaorrlj  frorr  a .Tagadne  ana  asks  how 
knowleage  stioula  te  eirployea  to  assist  in  interpreting  it. 
Sirtpli  asserting  that  we  shoula  apply  whatever  knowleage  is 
neeaea  to  resolve  the  a priori  uncertainty  about  the  iaentity  of 
various  objects  ana  their  interrelationsliips  is  not  an  answer, 
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for  this  IS  presumed  by  the  question.  The  question  asks  how  the 
relevant  knowledge  can  be  identifiec.  Once  again,  the  answer 
a{.{.ears  to  be  that  the  best-matching  frames  should  be  chosen  to 
interpret  the  cata.  In  most  cases,  even  test-matchec  frames  will 
only  be  partially  satisfied,  because  observec  objects  are 
occlucec  or  otherwise  fail  to  conform  [lerfectly  to  the 
{.reconceivec  frame  constraints.  Once  tlie  test-matched  frames 
have  teen  identified,  their  knowlecge  can  be  ex{.loitec  to 
hy[.othesize  ana  test  the  apparently  missing  or  erroneous  aata 
constituents . 

Because  no  frame,  by  itself,  can  be  expected  to  give  a 
thoroughi  account  of  the  significant  features  of  anj  normal, 
reasonably  complex  scene,  satisfactory  interpretations  will 
norm^ally  require  the  integration  of  several  partially  matchea 
frames.  Two  ways  of  determining  the  appropriate  combination  of 
frames  can  be  proposed:  (1)  frames  should  be  triec  one-at-a~time  , 
and  additional  frames  shoula  be  incorporatea  as  needed  to  resolve 
resiaual  or  anomalous  properties;  (2)  some  identifying 
characteristics  of  appropriate  frames  shoula  be  aiscerned  through 
an  analysis  of  global  properties  of  the  problem,  ana  then  frames 
satisfying  these  dynamically  determined  criteria  should  be 
invoked.  In  the  next  subsection  some  recent  results  of  speech 
anc  image  unaers tancing  research  are  presented  favoring  the 
secona  alternative. 


Speech  ang  Lmag.e  Unaers  t anging . Speech  unaerstanaing 
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systeir.s  face  ttie  task  of  fincing  the  test-fitting  inter (.retation 


'^or  a noisy,  yaran^etric  tine  series.  The  yararr.eters  are  acoustic 


n^easurements  ana  the  interpretation  is  a hierarchical  tree  whose 


root  is  a semantic  template  from  the  language  anc  whose 


intermeaiate  levels  represent  phrases,  words,  syllables,  phones. 


ana  acoustic  segments  [16,  20].  An  'nter pretation  is  constructec 


by  applying  knowleage  of  possible  mappings  between  intermeaiate 


levels.  In  the  Hearsay-II  system.  in  particular,  the 


interpretation  process  occurs  basically  in  two  phases.  First, 


knowledge  about  the  acoustic  realization  of  words  is  usea  to 


hypothesize,  totton-up  , plausible  words  at  various  temporal 


locations  within  an  utterance.  For  example,  if  the  sentence 


contains  1C  worcs  chosen  frotr  a ICCC-wora  vocabulary,  about  7 or 


8 on  the  average  are  correctly  hyp othesizec . In  adcltion  , 


approximately  200  incorrect  woras  are  hypothesized,  and  about  40 


of  these  are  actually  rates  higher  than  valid  word  hypotheses. 


In  the  secona  phase,  rrissing  woras  are  hypotbiesized  ana 


rates  ana  the  entire  sequence  of  worcs  in  the  sentence  is  parsed 


ana  assignee  an  overall  semantic  interpretation . The  key  problem 


in  this  phase  is  to  generate  ana  rate  the  most  plausible,  missing 


woras.  Even  when  the  vocabularj  anc  granmar  are  highly 


constrainec,  the  size  of  the  search  space  for  possible 


grammatical  word  sequences  is  extraordinarily  large.  In  the 


Hearsay-II  system  several  approachies  to  this  problem  were  tried, 


anc  only  one  approach  apparently  cerivec  sufficient  constraint, 


by  applying  enough  knowledge  simultaneously,  to  succeed.  The 
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ti.ethoa  usea  was  to  f.artial-n:atch  the  entire  collection  of 
totton-u;.  wore  hyi-otheses  against  all  terr. ylates  of  the  grannar, 
in  {.arallel  , in  the  hoi:e  of  fincing  one  sequence  of  highly-ratec 
worcs  that  was  graii.rr.atical  ana  nost  {irobatly  valic.  If  such  a 
sequence  coula  be  icentifiea,  the  systen  {.redicted  and  rated  its 
[.lausible  word  extensions,  iteratively,  until  a corrt.lete 
interpretation  of  the  sentence  was  constructec. 

Two  knowledge  sources  were  involvec  in  computing  the  partial 
rr.atch  between  the  rr.atrix  of  hypothesized  worcs  anc  the 
grarr,rr.atical  case  frarres.  These  were  W03EQ  [21],  a wore  sequence 
hy pothesizer  , ana  PPARSE  [12],  a partial  parser.  In  overview, 
WOSEQ  uses  knowleage  about  the  acjacency  of  woras  in  the  language 
to  forn.  hy  p.o the t ical  wora  sequences  by  concatenating  successive 
language-ac jacent  ana  tirr:e-aa jacent  wora  hypotheses.  It  prunes 
the  search  space  further  by  terminating  the  concatenation  process 
for  any  sequence  when  the  expected  benefit  is  less  than  the  cost, 
i.e.,  when  the  increase  in  creaitility  obtainable  bp 
concatenating  additional  word  hypotheses  is  insufficient  to 
warrant  the  attenaant  multip'licative  increase  in  the  total  number 
of  wora  sequences  generated.  Each  of  the  most  credible  wore 
sequences  iaentified  by  WOSEQ  is  then  evaluatea  bp  PPARSE  to 
aetermine  whether  it  is  actually  grammatical,  i.e.,  whether  it  is 
a subsequence  of  some  sentence  in  the  language.  Eacti  of  these 
partial  matching  procedures  is  now  explainea  in  more  aetail. 

WOSEQ  uses  a p-recomputea  bit  matrix  that  specifies 


for  each 
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{.osaible  word  [.air  (u,  v)  whether  the  sequence  u v can  occur  in  a 
sentence  of  the  language.  For  the  ICCC-word  vocabulary,  this 
requires  apt roxirrately  3CK  36-tit  words  of  iremory.  Given  a 
collection  of  tottorr-uf.  word  hytotheses,  WOSEQ  selects  a few  of 
the  n.ost  creaible  ones  as  seeds  for  its  sequence-growing  trocess. 
Each  seea  is  a one-worc  sequence  , ana  the  following  {.i^ocedure  is 
atpli^Q  reteatealy  to  all  sequences  until  quiescence  occurs: 


(1)  For  each  word  sequence  W,  construct  the  sets  P(  W)  ana 
3(w)  of  wora  hytotheses  tfiat  can  [.i^ecede  and  succeea  W. 
P(  W)  contains  all  hytotheses  that  are  both  language- 
acjacent  ana  tin.e-aa jacent  to  the  first  wora  in  W.  The 
set  S(  v;)  contains  all  hytotheses  that  are  tirr.e  ana 
language-aa jacent  to  the  last  word  of  W. 

(2)  For  each  w in  P(  W)  evaluate  the  credibility  of  the 

sequence  (w,  \I)  . This  is  an  increasing  function  of  the 

creaibility  of  w ana  W,  an  increasing  function  of  the 
total  nunter  of  syllables  scanned  by  (w,  M) , ana  a 
aecreasing  function  of  the  nunter  of  words  in  P( W) . If 
the  credibility  of  the  sequence  (w,  W)  is  greater  than 
that  of  W,  aca  (w,  VO  to  the  set  of  hypotliesizea 
sequences.  For  each  wore  w in  S(  V^)  , siirilarly  ^.rocess 

the  f.otential  sequence  ( W,  w). 


V/I.en  WOSEQ  quiesces,  it  will  have  identifiec  sequences  of 
(.airwise-grarrn.atical  woras  that  a[:^ear  to  be  nost  creaible  over 
the  entire  set  , both  because  they  incorporate  at  least  one  of  the 
inaiviaually  !Tost  creaible  totton-up  hjpotheses  ana  because  they 
satisfi  a naxinutr  nunter  of  low  protatiliti  constraints.  WOSEQ 
is  usually  successful  at  its  task,  because  it  continually 
increases  thie  creaibility  of  the  objects  it  processes.  It  coes  | 

this  by  adducing  contextual  support  in  the  forn  of  nunerous  , 
consistent,  unlikelj  observations.  The  algorithn  is  efficient 


because  tVie  tine  anc  language-aa jacency  constraints  are  easily 


2C- 


Gont-utea.  In  a later  section  of  this  {.aper,  it  is  sug^estec  that 
easily  coaputatle,  glotal  attributes  of  the  problerr,  space  rr.ay 
provice  a pron.ising,  general  approach  to  the  partial  n.atching 
problerr. . 

The  next  step  in  the  linguistic  partial  rratching  protlen.  is 
to  test  each  wore  sequence  for  grann.aticality . This  requires  a 
parser  capable  of  recognising  the  grarrrraticalicy  of  any  word 
sequence  , even  if  it  is  only  a subsequence  of  the  string 
derivable  frorr,  a non  berrr  inal . In  Hearsay-IJ  , this  is 
accotrplishea  by  a prograrr.  PPARSE.  PPARSE  is  a bottorr-up  , left- 
to-right  Kay-type  parser  with  the  following  rrodifications : Any 
rewrite  rule  such  as  X ->  A B can  be  applied,  ana  the  parse  noce 
X constructea  , whenever  the  leftmost  cerivative  of  B in  the  parse 
tree  is  the  first  word  of  the  sequence  being  partial-parsed . 
Similarly,  any  rewrite  like  Y ->  C D can  be  applied  whenever  the 
rightmost  cerivative  of  C is  the  last  word  of  the  sequence  being 
partial-parsec.  Tbiese  are  the  only  cases  in  which  incomplete 
tree  structures  are  built. 

W03EQ  ana  PPARSE  succeedec  at  controlling  the  combinatorics 
of  the  search  problem,  while  a number  of  procuction  systems 
failed  [16,  27],  because  hypotheses  that  satisfy  many  of  WOSEQ's 
constraints  are  likely  to  be  valid.  Furthermore,  the  truly 
expensive  operation  in  this  partial  matching,  instantiating  and 
hypothesizing  incomplete  grammatical  case  frames,  occurs  only 
when  an  incomplete  nonterminal  can  appropriately  cerive  t(ie  first 
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or  last  wore  of  a sequence  selectee  by  W03EQ.  ron4arec  to  any 
sirr^listic  conception  of  how  a frane  systerr..  can  operate  to 
hypothesize  and  then  fill  in  partially  instantiatec  frames,  W03EQ 
and  PPARSE  constitute  a signif icant ly  superior  solution  to  the 
best  match  problem. 

The  last  example  of  partial  matching  to  be  considerec  is  the 
problem  of  determining  stereo  cisparity  between  two  images  that 
are  left  ana  right-eye  views  of  one  scene.  To  resolve  the 
aisparity  between  two  images  of  this  sort  , it  is  necessary  to 
partial-match  them  to  identify  the  corresp oncing  (same)  objects 
in  each  image.  Once  this  is  aone  , the  lateral  cisplacement  or 
cisparity  between  the  two  is  a cue  for  the  aistance  of  the  object 
from  the  viewer.  The  hum;an  visual  system,  is  capable  of  resolving 
such  aisparity,  even  when  there  are  no  distinguishable  objects  in 
either  view  (as  in  rancom-dot  stereograms).  Recently  Marr  and 
Poggio  [22]  have  shown  how  the  necessary  partial  matching 
computations  can  be  performea  locally  by  spatially  cistrituted  , 
cooperative  processes.  Their  approach  rests  on  the  observation 
that,  while  the  aisparity  between  any  two  corresponaing  points  is 
initially  unknown,  any  biypothesis  regarcing  some  particular 
aisparity  value  between  two  points  in  the  two  images  im.plies 
approximately  the  same  aisparity  value  between  neighboring 
points.  By  constructing  a problem  representation  in  whiich  everp 
possible  pair  of  corresponaing  points,  with  disparitp  a, 
influences  the  neighboring  points  with  matching  properties  toward 
corresp oncences  unaer  the  same  aisparitp,  a cifference  equation 
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is  consbructea  that  can  be  at,{.lied  iteratively  anc  locally  to 
choose  corresf.  ondences  that  n,axirTiize  constraint  satisfaction.  A 
solution  in  this  algorithrri  is  just  a steacy-state  reaches  ty  the 
aifference  equation. 

This  att'lication  of  {.artial  rratching  is  particularly 
interesting,  because  it  shows  how  global  features  of  the  protlen 
space,  such  as  disparity  and  spatial  position,  ca  i constrain  the 
search  for  the  test  rratcbi.  The  global  corrrr  unication  of 
constraint  is  accotr  p listed  ty  cirectly  connecting  neighboring 
points  whose  hypothetical  cisparity  values  influe.nce  one  another. 
To  cevelop  a ruechanisn.  capable  of  this  sort  of  in  format:  on 
sharing,  a representation  had  to  be  ciscoverec  that  clarifies  the 
relationsliip  between  global  data  attributes  (location  anc 
disparity)  and  local  computations  invclvec  in  partial  matching 
( aetermining  the  grey-scale  similarity  of  two  potentially 
corresponding  points).  The  role  of  this  integratea  global-local 
problem,  representation  is  comparable  to  that  playea  ty  the 
precomputed  language-adjacency  matrix  used  ty  WTSEQ  to 
hypothesize  word  sequences  in  Hearsay-II.  This  suggests  some 
interesting  properties  of  the  partial  matching  problem  that  are 
pursued  in  ttie  subsequent  sections. 

PRINCIPAL  PROPERTIES  OF  THE  PARTIAL  MATCHING  PROBLEM 

From  the  preceaing  illustrations,  it  is  possiti^e  to  identify 
four  principal  characteristics  of  the  partial  matching  problem. 
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In  this  section,  these  are  briefly  discussed. 

The  desirability,  of  analyzing  any  t. articular  configuration 
of  cata  c^n  only:  be  determineg  gynarr.ically . In  the  large  class 
of  problems  where  partial  matching  is  necessary  and 
computationally  expensive,  the  number  of  cistinct  partial  matches 
that  can  arise  is  virtually  limitless.  As  a result,  it  is  not 
possible  to  [.reoe  termine  all  combinations  of  observable 
properties  that  m.ay  , at  somie  tim^e  , m;ost  warrant  soiTie  response.  A 
fortiori  , it  is  not  possible  to  rank  order  the  potential 
situations  in  terms  of  im.port  or  interest  value.  Rather,  the 
choice  of  which  configurations  of  cata  oeserve  further  processing 
resources  is  determinable  only  as  a result  of  dynamic  partial 
m'atching  between  the  data  in  hang  and  the  framjes  or  templates 
specifying  known  constraints. 


Paryt ial  matching , ^ a general  computational  iroblemj , is 
intractable . Because  partial  matching  subsumes  the  graph 
monomorphism,  the  k-clique  , and  other  NP-complete  problemis,  the 
amount  of  timie  apparently  needed  to  solve  worst-case  problems  is 
at  least  exponential  in  the  comiplexity  of  the  structures  being 
mjatched.  It  follows  that  if  partial-matching  is  to  be  applied 
successfully  , problem  complexity  must  be  reduced.  The  principal 
way  in  which  such  complexity  reduction  can  be  accomplished  is  by 
choosing  rich,  high-order  predicates  as  a basis  for  description. 
As  the  grain  of  description  is  reduced  towaro  uniform,  low-level 
predicates  (e.g.,  simple  graphs,  retinal  arrays  of  on-off 
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aetectora  , seriantic  (.rinitiveo ) , the  {.artial  natching  {.rotlerr 
rr.aae  inherently  rrore  cotr.[.lex  anc  lens  feanitle. 


Partial  matching  is  f uncamental  ly.  nonce  ter  ri_ini3  tic  . Thun 

far  in  this  [,at.er  the  nonceterti  inisrr  of  {.artial  matching 
algorithms  has  teen  neglectec  , [Lrirrarily  tecause  one  {.artial 
match  solution  is  usually  test.  Thus,  while  any  {.rogran  cesignec 
for  (.artial  matctiing  must  incor (Lorate  logic  that  (ermits  it  to 
(.ursue  multi(.le  solutions  simultaneously,  effective  mechanisms 
will  quickly  (.rune  {.oor  alternatives  from  consicerat ion . 


Goog  Lsrtial  rLatchies  .traverse  a L.riori  tounaaries  ana 
mul tihls  Levels  of  hier^ch ically  or gani ze.d  know le age  structures  . 
This  (Loint  is  of  the  utmost  im(:ortance  for  unaerstancing  why 
sim  ple  a(.  (.roaches  to  (.attern-airectec  inference  or  frame- 
theoretic  analysis  of  real  aata  are  likely  to  fail.  Sim(le 
a(  (.roaches  will  attempt  to  hy(othesize  all  (artial-matchec 
frames  ana  then  (.recict  anc  verify  their  missing 
consti tuents . Jn  any  reas&natlj  com (lex  domain,  the  test 
inter(retation  of  cata  will  traverse  a (riori  tounaaries  of 
several  low-orcer  frames  anc  will  onlj  te  a((arent  when  multi(le 
levels  of  (ar tial~m atchec  frames  are  integratec.  The  simple 
approach  entails  extensive  unwarrantec  searching  of  many  levels 
of  frames,  tecause  huncrecs  of  frames  can  be  consistent 


with  at  least  some  properties  of  the  observed  data.  Ttie  search 
for  a test  overall  interpretation  can  te  effective  only  if 
many  properties  of  the  cata,  provicing  multiple  sources  of 
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cons  traintiJ  , are  nonGiaerea  bin.ultaneouGly  . 

lAE  PARTIAL  HATCH  ADIl  I SSI  BI L.  I T CRITERIOH 

Any  [,ro{.OGeG  al^or'ithn  for  [.artial-rratching  two  structures  A 
ana  3 ouf>ht  to  satisfy  tre  following  criterion: 

TLe  nore  sinilar  A ana  3 are  (ever;>  thing  else  hela 
constant),  the  faster  the  [.artial  natch  shoula  be. 

This  criterion  is  cal  lea  the  LaCtial  rr,atch  a^cjLissi t ili t_y 
criterion.  Its  reasonat leness  ana  cesiratility  are  intuitively 
ai-t-arent.  Yet,  even  in  the  Ginp.lest  aj.  {.  lications  of  [.artial 
rratching,  it  is  rarely  achievable  [33J-  Tb-e  cause  is  that 

tyi.ical  [.artial  rratching  algorithns  evaluate  [.royerties  one-at- 
a-tirre.  For  exarr[.le,  if  we  wish  to  fine  a aocurrent  that  has 
keys  (attritutes)  g,  h,  anc  k,  nost  [rooecures  acconilish  this 
tj  intersecting  the  invertea  lists  of  cocunents  associatec  with 
each  of  the  three  ke^s.  Ttius  , it  takes  longer  to  fine  a 
Gocurrent  that  natches  1C  keys  than  to  fine  one  that  iratches  3, 
anc  so  forth. 

Avenues  of  a[  [.roach  towara  realizing  acnissitle  algorithns 
are  suggestec  ty  consicering  [.artial  natching  as  a search  [.rotlen 
in  which  each  [.artial  natch  corres[onas  to  a state.  The  initial 
state  is  re[.re3enteG  as  a three-tu[le,  ((),  A,  F),  where  A is  the 
otservea  aata  re  [.  resen  tat  ion  (or  query)  ana  F is  a set  of  franco 
against  which  A can  te  con  [.area.  As  before,  the  first  confonent 


i 


represents  the  abstraction  or  partial  natch  thus  far  constructea. 
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the  second  cott.f.onent  ref.resents  the  residual  of  A with  respect  to 
this  abstraction,  anc  the  third  conjonent  represents  the 
residuals  of  the  fran^es  vis-a-vis  the  current  abstraction. 

By  applying  typical  acrr'issitility  criteria  of  general 
searchies  [30],  it  is  apparent  how  one  should  rr.ove  through  this 
search  space.  At  each  decision  point  in  the  algorithm,  the  most 
promising  partial  solution  should  be  extended.  The  most 
promising  extension  is  the  one  providing  the  most  complete 
partial  match  for  tbie  least  expense.  Here,  expense  is  defined  as 
the  total  computation  required  to  arrive  at  any  given  state, 
including  both  the  computation  timje  spent  developing  the 
particular  partial  mjatch  as  well  as  the  time  spent  constructing 
collateral  matches  from  expanded  partial  solutions  on  the  same 
path.  Thus,  the  best  step  at  each  point  is  the  one  which  adduces 
the  most  constraint  for  the  least  cost.  Constraint  in  this  case 
is  exactly  definable  as  the  reduction  in  the  remaining 
uncertainty  regarding  which  frames  of  F are  involved  in  the  test 
match  of  A. 

From  this  viewpoint,  it  appears  that  there  is  only  one 
interpretation  of  constraint.  A transformation  from  one  partial 
matching  state  to  another  is  constraining  to  the  extent  to  which 
it  eliminates  possible  elements  of  F from  further  consideration. 

Two  useful  concepts  in  this  context  are  the  a.iag,nqst ici t^  of 


a test  and  its  performance..  Diagnosticity  is  a measure  of  the 
ability  of  a test  to  rule  out  possibilities.  Performance  is  a 
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conii-osite  treasure  of  the  exj-ected  utility  of  a test,  coir.tinint’ 
its  diagnosticity  with  its  expected  frequency  of  satisfiability 
[3].  An  0{.tinal  algorithti.  would  aj;[:ly,  at  each  cecision 
{.oint  , the  tT'Ost  diagnostic  test  that  is  satisfiatle. 
Expected  cost  can  be  minin.izec  by  aj.  flying  the  tests  with  highest 
performance  values  at  each  decision  point.  Such  an 
approximation  is  important  , because  we  know  of  no  reasonable  way 
to  determine  cynamically  the  most  ciagnostic  tests.  Sorre  avenues 
of  approach  to  these  problems  are  suggested  in  the  next  section. 

IMPLICATIONS  FOR  THE  DESIGN  OF  KNOWLEDGE  SYSTEMS 

From  this  stucy  of  partial  matching,  four  general 
imi plications  for  the  cesign  of  knowleage  systems  are  drawn.  Each 
of  these  is  consiaerec  in  turn. 

Analyses  should  be  synthetic  and  dynamic . This  criterion  , 
although  souncing  superficially  like  a suggestion  for  analysis- 
by-synthesis,  is  cian.etrically  opposed  to  that  approach.  In 
analysis-by-synthesis  [19],  patterns  are  interpreted  by  top- 
Gown  methoGs:  one  most  likely,  highest-level  frame  is  selectee 
arbitrarily  to  apply  and,  at  each  point,  unfilled  franes  are 
expanded  downwaro  until  they  can  fit  (interpret)  th.e  data. 
Because  such  search  strategies  are  insensitive  to  properties  of 
the  aata  at  hanc , they  will  perform  bacly  unless  more  constraint 
is  available  from  the  top-oown  structure  of  the  frame  system 


than  from  tests  tasec  on  diagnostic  combinations 


of  data  anc 
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fraujes.  To  be  si.nUj.etic  tijeans  choosing  tests  to  {.erfora  which, 
in  view  of  the  i_ro[..erties  exhititec  by  the  cata , af.[.ly  n^axin.al 
constraint.  Knowleage  systenis  designee  along  these  lines  would 
err^loy  a basic  three-stef  cycle:  (1)  a small  number  of  highest- 
(.erfornance  tests  are  a^pliec  to  the  test  partial  solutions 
(initially,  to  the  most  crecitle  cata);  (2)  the  most  promising 
matches  are  extencec;  ana  (3)  the  new  test  matches  are 
iaentifiec  for  evaluation  ty  another  set  of  highest-p er formance 
tests.  Note  how  this  paracigm  embraces  the  V/OSEQ- PPARSE 
methoaologi  cescrited  earlier. 

Descrii tions  shgulg  be  rich  ana  simple.  To  reduce  the 
complexity  of  the  search  problem,  descriptions  should  te  as  rich 
and  simple  as  possible.  This  criterion  implies  that  high-level 
aescriptors  are  m.ore  desirable  than  low-level  ones.  For  example, 
language  processing  systems  representing  knowleage  in  terms  of 
lexem.es  are  more  efficient  than  those  representing  such  knowleage 
in  the  form,  of  equivalent  graphs  of  semantic  primitives  [7].  One 
particularly  interesting  aspect  of  Merlin  is  its  use  of 
hierarchical  aescriptions  permitting  partial  matching  to  be 
performea  at  ttie  highest-level  of  cescription  possible.  Merlin's 
partial  matcher  descencs  into  the  aepths  of  low-order 
descriptions  only  if  matches  of  rich,  high-level  terms  fail. 
This  criterion  is  actually  a heuristic  for  achieving  maximally 
constraining  tests  for  the  least  cost.  Its  actual  effectivness 
aepends  on  the  exact  performance  of  tests  at  high  and  low  levels; 
in  reasonable  problem  domains,  however,  the  heuristic  shoula  te 
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generally  valia. 

Scheduling  of_  con. lubational  resources  , tase.Q.  on 
QiagnosbicitN  or  erf  orn.ance  , shoulc  t.e  consicerec  a irin  itive 
f unction  in  tartiai  rrabching  systems . Con  {.lex  partial  matching 
systems  must  include  mechanism.s  to  insure  ttiat  the  most  desirable  I 

actions  are  executed  first.  Two  properties  of  scheculers  are 
proposed.  First,  desirability  shoulc  primarily  reflect  the 
ciagnostici ty  of  a pending  action.  Second,  since  scheduling  is  a 
prin.itive  operation,  the  costs  of  calculating  desirabilities  and 
sorting  the  pending  actions  shoulc  be  minimized.  In  this  i 

context , it  is  interesting  to  note  that  previous  stucies  of  j 

knowledge  system  scheduling  [13]  and  conflict  resolution  in  j 

production  systems  [ 23,  29]  have  com.pletely  neglected  the  concept 

I 

of  diagnosticity . 

Problem  representations  shoulc  integrate  characteristics  of  | 

i 

the  knowledge  base  with  iroperties  of  the  cata  to  maximize  j 

.1 

the  constraint  providec  in  search.  This  criterion  suggests  tliat  j 

one  approach  to  improvec  performance  in  partial  matching  I 

} 

is  to  cevelop  globally  organized  representations  whiose  ] 

attributes  can  be  exploited  to  recuce  uncertainty  during  | 

partial  matching.  The  work  of  Harr  anc  Poggio  [22]  on  stereo  1 

I 

cisparity  is  a good  example  of  the  use  of  such  a globally 


-30- 


neighborhood  of  the  probletE  space.  The  essence  of  such  spatial 
organizations  is  an  ability  to  reduce  the  nuriiter  of  coriiputations 
involved  in  similarity  judgments.  Similar  benefits  were  provided 
to  the  partial  matcher  in  t'lerlin  as  a result  of  its  hierarchical 
organization  of  knowledge . 


In 

the 

f uture  , 

representations  should 

be  sought  which 

support 

the 

use  of 

proximity  measures  or 

directionality  to 

identify  good  partial  matches.  These  could  provide  cheap  and 
constraining  tests  for  a variety  of  tasks.  For  example, 
semantic  networks  might  be  superimposec  upon  the  type  of 
metric  semantic  spaces  which  humans  apparently  possess  [32,  34, 
39].  The  value  of  such  organizations  would  derive  from  an 
improved  capacity  to  detect  that  two  objects  are  likely 
correspondents  (are  highly  similar)  just  because  they  are  close 
in  the  metric  representational  space.  Moreover,  such  integratec 
spatial  and  symbolic  representations  could  significantly  improve 
intersection  searches  by  favoring  spreac  of  activation  in  the 
"area"  between  two  concepts  of  interest.  Given  the  coordinates 
of  two  noaes  to  be  connected  by  a best  path,  preference  should  be 
given  to  out-going  links  that  are  oriented  in  appropriate 
airections . 

Other  types  of  organization  should  also  be  sought  that  can 
facilitate  corrputation  of  ap'proximate  similarity.  For  exanple, 
in  early  experiments  in  rule  induction,  Hayes-Roth  anc 
McDermott  [15]  showed  how  transfortrational  grammar  rules  could 
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be  inferrea  by  partial-matching  bef  ore-and-af  ter  examiples. 
Their  program  employed  no  knowledge  about  either  the  structure 
of  productions  or  sentences.  By  incorporating  properties  of 
these  structures  as  attributes  of  the  representations,  Vere  was 
able  to  reduce  the  computation  time  by  two  orders  of  magnitude 
[33].  The  organizing  properties  he  exploited  included  a three- 
part  decomposition  of  each  production,  corresponding  to  the 
three  components  of  the  partial  match  of  the  before  and  after 
parts  of  each  example,  and  a hierarchical  representation  of 
sentences.  The  additional  constraints  provided  by  these  global 
attributes  of  problem  organization  greatly  simplify  this 
particular  partial  matching  problem. 

CONCLUSIONS 

I have  triea  to  show  in  this  paper  that  partial  matching 
is  central  to  miany  interesting  functions  of  knowledge  systems. 
A few  years  ago,  the  foremiost  problem  of  knowlege  system 
design  was  how  knowledge  should  be  represented.  While  knowlecge 
representations  are  continually  improving , many  good  frameworks 
have  already  been  developed.  Since  pattern-directed  function 
invocation  is  obviously  desirable  for  many  applications  of  these 
knowledge  systems,  attention  has  recently  focused  upon  good 
m.ethoGs  to  invoke  appropriate  knowledge  units.  Within  the 
framework  of  all-or-none  knowlecge  application,  the  major  topics 
of  interest  concern  matters  of  efficiency,  such  as  developing 


me  thocs 


for  common 


subexpression  elimination  , 


efficient 
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techniques  for  all-or-none  (.attern  rratching,  ana  strategies  ' 

for  conflict  resolution.  Wiile  these  are  surely  in.[.ortant 

consiaerations  in  in, len.enting  s^stens  for  sini..le  or  well- 
structurec  tasks,  the  n.ost  aifficult  i:rotlen  arising  in  very  | 

large  and  flexible  knowlecge  systenis  is  to  ceternine  , as  i 

quickly  as  possible  , the  niost  useful  knowleage  for  the  task 
at  hana.  Because  n,any  diverse  elenents  of  knowledge  nay 

be  weakly  contributory  to  an  overall  solution  , new  ways  of 
organizing  con,putation  must  be  aevelopeo  to  prevent  intractable, 
con,binatorial  searcties.  In  the  future,  a n:ajor  shift  in 

attention  can  be  anticipated  toward  the  aecei.tively 

easil}  statea  but  funcan.ental  question:  How  shoula  partial  and 
best  n,atches  be  con.puted? 
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